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DETAILED ACTION 



Response to Amendment and Arguments 

1 . Applicant's amendment filed on January 4, 2006 has been entered and made of record. 

2. In view of applicant's amendment, the 1 12 first paragraph rejections are withdrawn. 

3. Applicant's arguments, see pages 12-14, with respect to the rejection(s) of claim(s) 1 and 
4 have been fully considered and are persuasive. Therefore, the rejection has been withdrawn. 
However, upon further consideration, a new ground(s) of rejection is made in view of the 
combination of Lu, U.S. Patent No. 5,852,672 ("Lu"), Miramonti et al., U.S. Patent No. 
6,288,385 ("Miramonti"), and Suda, U.S. Patent No. 6,067,115 ("Suda"), the details of which are 
provided below. 



Claim Rejections - 35 USC §112 



The following is a quotation of the first paragraph of 35 U.S. C. 112: 

The specification shall contain a written description of the invention, and of the manner and process of making 
and using it, in such full, clear, concise, and exact terms as to enable any person skilled in the art to which it 
pertains, or with which it is most nearly connected, to make and use the same and shall set forth the best mode 
contemplated by the inventor of carrying out his invention. 



4. Claims 12-13 are rejected under 35 U.S.C. 1 12, first paragraph, as failing to comply with 
the enablement requirement. The claim(s) contains subject matter which was not described in 
the specification in such a way as to enable one skilled in the art to which it pertains, or with 
which it is most nearly connected, to make and/or use the invention. 
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Referring to claim 12, the applicant's specification does not provide enabling support for 
the claimed features. More specifically, the applicant's specification fails to show how a single 
capturing section including a single lens section and a single shutter that is used to capture 
images by movement of the lens section can also include a plurality of capturing units at three or 
more viewpoints which are not aligned on one line. It appears that the apparatus recited in claim 
1 and the features recited in claim 2 are incorporated in two completely different structures (see 
figures 9 and 15 respectively), and it is unclear how both structures can be integrated into one 
apparatus as claimed. Therefore, the applicant's specification fails to provide enabling support 
for the features recited in claim 12. 

Claims not mentioned specifically are dependent from non-enabled antecedent claims. 

Claim Rejections - 35 USC § 103 
The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

5. Claims 1, 3-5, 10, 1 1 are rejected under 35 U.S.C. 103(a) as being unpatentable over the 
combination of Lu, U.S. Patent No. 5,852,672 ("Lu"), Miramonti et al., U.S. Patent No. 
6,288,385 ("Miramonti"), and Suda, U.S. Patent No. 6,067,115 ("Suda"). 

Referring to claim 1, Lu discloses an image capturing apparatus for obtaining information 
regarding a depth of a subject, comprising: 
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a. a capturing section (40) operable to perform image capturing for the subject at a 
plurality of viewpoints (col. 5, lines 30-55 and figure 2) 

b. a controller operable to control the capturing section to perform the image 
capturing at different timings at the plurality of viewpoints (col. 7, lines 12-25 and figure 6) 

c. the controller controls the capturing section to perform the image capturing for the 
subject two or more times at the at least one of the plurality of viewpoints (figure 6). 

Lu does not explicitly disclose that the capturing section includes a single lens section 
and a single shutter for capturing the subject at a plurality of viewpoints (Note that Lu's 
capturing section comprises multiple imaging units). However, this feature was exceedingly 
well known in the art. For example, Miramonti discloses a single capturing section (110) 
including a single lens section (111) and a single shutter (111) operable to perform image 
capturing for a subject at a plurality of viewpoints, and a controller to control the single 
capturing section to perform image capturing at different timings at the plurality of viewpoints 
(col. 6, lines 5-32 and figure 1C). Miramonti explains that the use of multiple capturing sections 
arranged at different viewpoints can be interchanged with the use of a single capturing section 
translated around the subject (figures 1C and ID). 

Lu and Miramonti are combinable because they are both concerned with image capturing 
devices for obtaining depth information of a subject. At the time of the invention, it would have 
been obvious to a person of ordinary skill in the art to modify the image capturing section of Lu 
so that it comprises a single capturing section with a single lens and shutter, as taught by 
Miramonti. The suggestion/motivation for doing so would have been to enhance the flexibility 
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of the imaging system by providing multiple configurations of the image capturing section. 
Therefore, it would have been obvious to combine Lu with Miramonti. 

Lu and Miramonti do not explicitly disclose that the images are captured by controlling a 
movement of the lens section from a first position to at least a second position within the single 
capturing section. However, this feature was exceedingly well known in the art. For example, 
Suda discloses a controller for controlling a single capturing section (video camera) to capture 
multiple images at a plurality of viewpoints by controlling a movement of the lens section from a 
first position to at least a second position within the single capturing section (abstract). 

Lu, Miramonti, and Suda are combinable because they are all concerned with imaging an 
object using a video camera. At the time of the invention, it would have been obvious to a 
person of ordinary skill in the art to modify the image capturing section (video camera) of Lu 
and Miramonti so that the images are captured by controlling a movement of the lens section 
from a first position to at least a second position within the single capturing section, as taught by 
Suda. The suggestion/motivation for doing so would have been to enhance the accuracy and 
flexibility of the image capturing process by providing a highly accurate and stable automatic 
focus adjusting operation that is capable of detecting a focused image irrespective of the 
photographing environment or viewpoint (Suda, col. 2, lines 23-32). Therefore, it would have 
been obvious to combine Lu and Miramonti with Suda to obtain the invention as specified in 
claim 1. 

Referring to claim 3, see the rejection of claim 1 above. Lu does not explicitly disclose a 
viewpoint moving system operable to move a position at which the capturing section performs 
the image capturing for the subject to the plurality of viewpoints. 
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Miramonti discloses a viewpoint moving system operable to move a position at which a 
capturing section performs image capturing for a subject to a plurality of viewpoints, and a 
controller for controlling a capturing section to perform image capturing for the subject at a 
plurality of viewpoints successively by moving the position to the plurality of view points (col. 
6, lines 5-32 and figure 1C). Therefore, it would have been obvious to combine Lu and 
Miramonti, for the reasons stated above (claim 1). 

Referring to claim 4, Lu discloses an image capturing apparatus for obtaining information 
regarding a depth of a subject, comprising: 

a. a capturing section operable to perform image capturing for the subject at a 
plurality of viewpoints (col. 5, lines 30-55 and figure 2) 

b. a controller operable to control the capturing section to perform the image 
capturing at different timings at the plurality of viewpoints (col. 7, lines 12-25 and figure 6) 

c. the controller controls the capturing section to perform the image capturing for the 
subject two or more times at the at least one of the plurality of viewpoints (figure 6) 

d. a depth calculating unit operable to calculate a depth of a particular region of the 
subject based on two or more images obtained by the image capturing performed for the subject 
two or more times at the one viewpoint and another image obtained by the image capturing 
performed at another viewpoint different from the one viewpoint [col. 7, lines 12-25. Note that 
the (two or more) time series images (figure 6) are used to obtain time series three-dimensional 
surfaces (depth) of the subject]. 

Lu does not explicitly disclose that the capturing section includes a single lens section 
and a single shutter for capturing the subject at a plurality of viewpoints (Note that Lu's 
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capturing section comprises multiple imaging units). However, this feature was exceedingly 
well known in the art. For example, Miramonti discloses a single capturing section (110) 
including a single lens section (111) and a single shutter (111) operable to perform image 
capturing for a subject at a plurality of viewpoints, and a controller to control the single 
capturing section to perform image capturing at different timings at the plurality of viewpoints 
(col. 6, lines 5-32 and figure 1C). Miramonti explains that the use of multiple capturing sections 
arranged at different viewpoints can be interchanged with the use of a single capturing section 
translated around the subject (figures 1C and ID). Miramonti further discloses a depth 
calculating unit operable to calculate a depth of a particular region of the subject based on two or 
more images obtained by the image capturing performed for the subject (col. 6, lines 49-56). 

Lu and Miramonti are combinable because they are both concerned with image capturing 
devices for obtaining depth information of a subject. At the time of the invention, it would have 
been obvious to a person of ordinary skill in the art to modify the image capturing section of Lu 
so that it comprises a single capturing section with a single lens and shutter, as taught by 
Miramonti. The suggestion/motivation for doing so would have been to enhance the flexibility 
of the imaging system by providing multiple configurations of the image capturing section. 
Therefore, it would have been obvious to combine Lu with Miramonti. 

Lu and Miramonti do not explicitly disclose that the images are captured by controlling a 
movement of the lens section from a first position to at least a second position within the single 
capturing section. However, this feature was exceedingly well known in the art. For example, 
Suda discloses a controller for controlling a single capturing section (video camera) to capture 
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multiple images at a plurality of viewpoints by controlling a movement of the lens section from a 
first position to at least a second position within the single capturing section (abstract). 

Lu, Miramonti, and Suda are combinable because they are all concerned with imaging an 
object using a video camera. At the time of the invention, it would have been obvious to a 
person of ordinary skill in the art to modify the image capturing section (video camera) of Lu 
and Miramonti so that the images are captured by controlling a movement of the lens section 
from a first position to at least a second position within the single capturing section, as taught by 
Suda. The suggestion/motivation for doing so would have been to enhance the accuracy and 
flexibility of the image capturing process by providing a highly accurate and stable automatic 
focus adjusting operation that is capable of detecting a focused image irrespective of the 
photographing environment or viewpoint (Suda, col. 2, lines 23-32). Therefore, it would have 
been obvious to combine Lu and Miramonti with Suda to obtain the invention as specified in 
claim 4. 

Referring to claim 5, Lu further discloses a positional difference detecting unit operable 
to detect a positional difference of an image of the particular region of the subject based on the 
two or more images obtained at the one view point and the other image obtained at the another 
view point, wherein the depth calculating unit calculates the depth of the particular region of the 
subject based on the positional difference [col. 6, line 25-col. 7, line 11. Lu explains that the 
depth information of the subject (z-coordinate) is calculated based on the detected positional 
difference (camera parameters) of the two or more images obtained at one view point and the 
other image obtained at the another view point]. 
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Referring to claim 10, Miramonti further discloses that the viewpoint moving unit is 
capable of moving the capturing section at three or more viewpoints which are not aligned on 
one line (figure 1C). 

Referring to claim 1 1, Miramonti further discloses that the viewpoint moving unit is 
capable of moving the capturing section to a variety of different positions (figure 1C). 

6. Claim 8 is rejected under 35 U.S.C. 103(a) as being unpatentable over the combination of 
Lu, U.S. Patent No. 5,852,672 ("Lu"), Miramonti et al., U.S. Patent No. 6,288,385 
("Miramonti"), Suda, U.S. Patent No. 6,067,115 ("Suda"), and Bacs, Jr. et al, U.S. Patent No. 
6,324,347 ("Bacs"). 

Referring to claim 8, Lu, Miramonti, and Suda do not explicitly disclose that the image 
capturing section includes a light converging unit operable to converge light incident thereon and 
a light-limiting unit having at least aperture for limiting a range where the light is allowed to 
pass, and a viewpoint moving unit that moves the aperture by moving the light-limiting unit, to 
realize a plurality of viewpoints. Bacs explains that this feature was exceedingly well known in 
the art (col. 3, lines 23-40 and figure 1). 

Lu, Miramonti, Suda, and Bacs are combinable because they are both concerned with 
stereo imaging systems. At the time of the invention, it would have been obvious to a person of 
ordinary skill in the art to modify the image capturing apparatus of Lu, Miramonti, and Suda in 
view of Bacs' teaching. The suggestion/motivation for doing so would have been to provide an 
imaging system that is compact in size, light weight, efficient in construction and operation, and 
convenient to implement in conventional video cameras (Bacs, col. 3, lines 17-22). Therefore, it 
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would have been obvious to combine Lu, Miramonti, and Suda with Bacs to obtain the invention 
as specified in claim 8. 

7. Claim 9 is rejected under 35 U.S.C. 103(a) as being unpatentable over the combination of 
Lu, U.S. Patent No. 5,852,672 ("Lu"), Miramonti et al, U.S. Patent No. 6,288,385 
("Miramonti"), Suda, U.S. Patent No. 6,067,1 15 ("Suda"), and Lo et al., U.S. Patent No. 
6,269,223 ("Lo"). 

Referring to claim 9, Lu, Miramonti, and Suda do not explicitly disclose that the 
capturing section includes a light-limiting unit having a plurality of apertures for limiting a range 
where light is allowed to pass, and that the viewpoint moving unit closes at least one of the 
plurality of apertures to realize the plurality of viewpoints. 

Lo discloses an image capturing system that includes a light-limiting unit having a 
plurality of apertures for limiting a range where light is allowed to pass, and a viewpoint moving 
unit that closes at least one of the plurality of apertures to realize the plurality of viewpoints (col. 
2, lines 13-37). 

Lu, Miramonti, Suda, and Lo are combinable because they are all concerned with stereo 
imaging systems. At the time of the invention, it would have been obvious to a person of 
ordinary skill in the art to modify the image capturing system of Lu, Miramonti and Suda, so that 
it includes the features taught by Lo. The suggestion/motivation for doing so would have been to 
provide a camera that is simple in design and capable of taking both mono and stereo images 
(Lo, col. 1, line 65-col. 2, line 1 1). Therefore, it would have been obvious to combine Lu, 
Miramonti, and Suda with Lo to obtain the invention as specified in claim 9. 
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8. Claim 14 is rejected under 35 U.S.C. 103(a) as being unpatentable over the combination 
of Lu, U.S. Patent No. 5,852,672 ("Lu"), Miramonti et al., U.S. Patent No. 6,288,385 
("Miramonti"), Suda, U.S. Patent No. 6,067,1 15 ("Suda"), and Moreton et al., U.S. Patent No. 
5,835,133 ("Moreton"). 

Referring to claim 14, Lu, Miramonti, and Suda do not explicitly disclose that the 
controller controls the capturing section to alternately perform the image capturing at two 
viewpoints three or more times. However, this feature was exceedingly well known in the art. 
For example, Moreton discloses a controller that controls a capturing section to alternately 
perform image capturing at two viewpoints three or more times (col. 8, lines 1-29). 

Lu, Miramonti, Suda, and Moreton are combinable because they are both concerned with 
stereo imaging systems. At the time of the invention, it would have been obvious to a person of 
ordinary skill in the art to modify the controller of Lu, Miramonti, and Suda so that it controls the 
capturing section to alternately perform the image capturing at two viewpoints three or more 
times, as taught by Moreton. The suggestion/motivation for doing so would have been to 
enhance the imaging process by providing the capability of high resolution image generation 
(Moreton, col. 8, lines 30-32). Therefore, it would have been obvious to combine Lu, 
Miramonti, and Suda with Moreton to obtain the invention as specified in claim 14. 
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Allowable Subject Matter 

9. Claims 6 and 7 are objected to as being dependent upon a rejected base claim, but would 
be allowable if rewritten in independent form including all of the limitations of the base claim 
and any intervening claims. 

10. Claims 1 5-22 are allowed. 

Conclusion 

1 1 . Applicant's amendment necessitated the new ground(s) of rejection presented in this 
Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). 
Applicant is reminded of the extension of time policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1. 136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the date of this 
final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Charles Kim whose telephone number is 571-272-7421. The 
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examiner can normally be reached on Mon thru Thurs 8:30am to 6pm and alternating Fri 9:30am 
to 6pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Jingge Wu can be reached on 571-272-7429. The fax phone number for the 
organization where this application or proceeding is assigned is 571-272-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 



ck 

March 7, 2006 




